Recommendations as Treatments: Debiasing Learning and Evaluation
نویسندگان
چکیده
Most data for evaluating and training recommender systems is subject to selection biases, either through self-selection by the users or through the actions of the recommendation system itself. In this paper, we provide a principled approach to handling selection biases, adapting models and estimation techniques from causal inference. The approach leads to unbiased performance estimators despite biased data, and to a matrix factorization method that provides substantially improved prediction performance on real-world data. We theoretically and empirically characterize the robustness of the approach, finding that it is highly practical and scalable.
منابع مشابه
Is it time for studying real-life debiasing? Evaluation of the effectiveness of an analogical intervention technique
The aim of this study was to initiate the exploration of debiasing methods applicable in real-life settings for achieving lasting improvement in decision making competence regarding multiple decision biases. Here, we tested the potentials of the analogical encoding method for decision debiasing. The advantage of this method is that it can foster the transfer from learning abstract principles to...
متن کاملWhen debiasing backfires: accessible content and accessibility experiences in debiasing hindsight.
Two studies demonstrated that attempts to debias hindsight by thinking about alternative outcomes may backfire and traced this to the influence of subjective accessibility experiences. Participants listed either few (2) or many (10) thoughts about how an event might have turned out otherwise. Listing many counterfactual thoughts was experienced as difficult and consistently increased the hindsi...
متن کاملFraming effect debiasing in medical decision making.
OBJECTIVE Numerous studies have demonstrated the robustness of the framing effect in a variety of contexts. The present study investigated the effects of a debiasing procedure designed to prevent the framing effect for young adults who made decisions based on hypothetical medical decision-making vignettes. METHODS The debiasing technique involved participants listing advantages and disadvanta...
متن کاملEFL Students’ Attitudes towards Self-Access Language Learning Centers (SALC): The Case of Iranian ESP Students
This article presents the attitude of ESP learners towards the role of Self-Access Language Learning Centres in improving their reading comprehension. It provides an evaluation of the success of these contents as well as an interpretation of students’ understanding of the related concepts. Finally it identifies factors that enhance or hinder the successful implementation of Self-Access Language...
متن کامل(De-)Biasing on a Roll : Changing Gambling Behavior through Experiential Learning
This paper tests experiential learning as a debiasing tool against gambling behavior in South Africa. We implement a simple, interactive game that simulates the odds of winning the national lottery through dice rolling. Participants roll one and two dice until they obtain simultaneous sixes and are then informed that the odds of winning the jackpot is equivalent to rolling all sixes with nine d...
متن کامل